2026-03-22 17:42:57,735 [ 261552 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2026-03-22 17:42:57,736 [ 261552 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths) 2026-03-22 17:42:57,736 [ 261552 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths) 2026-03-22 17:42:57,736 [ 261552 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:92, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_vf4j2m --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel1_0.jsonl --report-log-exclude-logs-on-passed-tests test_executable_dictionary/test.py::test_executable_input_bash test_executable_dictionary/test.py::test_executable_input_python test_executable_dictionary/test.py::test_executable_input_send_chunk_header_python test_executable_dictionary/test.py::test_executable_input_signalled_python test_executable_dictionary/test.py::test_executable_input_slow_python test_executable_dictionary/test.py::test_executable_input_sum_python test_executable_dictionary/test.py::test_executable_non_direct_input_bash test_executable_dictionary/test.py::test_executable_source_argument_python test_executable_dictionary/test.py::test_executable_source_exit_code_check test_executable_dictionary/test.py::test_executable_source_python test_executable_dictionary/test.py::test_executable_source_updated_python test_format_avro_confluent/test.py::test_select test_format_avro_confluent/test.py::test_select_auth test_format_avro_confluent/test.py::test_select_auth_encoded test_format_avro_confluent/test.py::test_select_auth_encoded_complex test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 test_keeper_snapshot_small_distance/test.py::test_snapshot_and_load test_kerberos_auth/test.py::test_bad_path_to_keytab test_kerberos_auth/test.py::test_kerberos_auth_with_keytab test_kerberos_auth/test.py::test_kerberos_auth_without_keytab test_log_levels_update/test.py::test_log_levels_update test_log_query_probability/test.py::test_log_quries_probability_one test_log_query_probability/test.py::test_log_quries_probability_two test_match_process_uid_against_data_owner/test.py::test_different_user test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting test_merge_tree_check_part_with_cache/test.py::test_check_part_with_cache 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-sipHash64(key)]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)]' test_parallel_replicas_increase_error_count/test.py::test_increase_error_count 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-1000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-10000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-100000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-1000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-10000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-100000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-1000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-10000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-100000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-1000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-10000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-100000-SELECT sum(key) FROM {table_name}]' test_password_constraints/test.py::test_complexity_rules test_password_constraints/test.py::test_default_password_type test_polymorphic_parts/test.py::test_compact_parts_only 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact]' 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1]' test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_profile_events_s3/test.py::test_profile_events 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-True]' -vvv " altinityinfra/integration-tests-runner:226bfaf75ac1 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-1000-SELECT sum(key) FROM {table_name}] test_executable_dictionary/test.py::test_executable_input_bash test_log_query_probability/test.py::test_log_quries_probability_one test_password_constraints/test.py::test_complexity_rules test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-False] test_format_avro_confluent/test.py::test_select test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-key] test_kerberos_auth/test.py::test_bad_path_to_keytab test_max_authentication_methods_per_user/test.py::test_alter test_polymorphic_parts/test.py::test_compact_parts_only [gw6] [ 1%] PASSED test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting [gw5] [ 2%] PASSED test_kerberos_auth/test.py::test_bad_path_to_keytab test_kerberos_auth/test.py::test_kerberos_auth_with_keytab [gw5] [ 3%] PASSED test_kerberos_auth/test.py::test_kerberos_auth_with_keytab test_kerberos_auth/test.py::test_kerberos_auth_without_keytab [gw5] [ 4%] PASSED test_kerberos_auth/test.py::test_kerberos_auth_without_keytab [gw6] [ 5%] PASSED test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create [gw6] [ 6%] PASSED test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting [gw9] [ 7%] PASSED test_password_constraints/test.py::test_complexity_rules test_password_constraints/test.py::test_default_password_type [gw6] [ 8%] PASSED test_max_authentication_methods_per_user/test.py::test_create_default_setting [gw9] [ 9%] PASSED test_password_constraints/test.py::test_default_password_type [gw2] [ 10%] PASSED test_executable_dictionary/test.py::test_executable_input_bash test_executable_dictionary/test.py::test_executable_input_python [gw2] [ 11%] PASSED test_executable_dictionary/test.py::test_executable_input_python test_executable_dictionary/test.py::test_executable_input_send_chunk_header_python test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 [gw2] [ 12%] PASSED test_executable_dictionary/test.py::test_executable_input_send_chunk_header_python test_executable_dictionary/test.py::test_executable_input_signalled_python test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table [gw2] [ 13%] PASSED test_executable_dictionary/test.py::test_executable_input_signalled_python test_executable_dictionary/test.py::test_executable_input_slow_python [gw1] [ 14%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-key] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-sipHash64(key)] [gw2] [ 15%] PASSED test_executable_dictionary/test.py::test_executable_input_slow_python test_executable_dictionary/test.py::test_executable_input_sum_python [gw2] [ 16%] PASSED test_executable_dictionary/test.py::test_executable_input_sum_python test_executable_dictionary/test.py::test_executable_non_direct_input_bash [gw1] [ 17%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-sipHash64(key)] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-key] test_keeper_profiler/test.py::test_profiler [gw2] [ 18%] PASSED test_executable_dictionary/test.py::test_executable_non_direct_input_bash test_executable_dictionary/test.py::test_executable_source_argument_python [gw0] [ 19%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-True] [gw2] [ 20%] PASSED test_executable_dictionary/test.py::test_executable_source_argument_python test_executable_dictionary/test.py::test_executable_source_exit_code_check [gw1] [ 21%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-key] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] [gw4] [ 22%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-1000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-10000-SELECT sum(key) FROM {table_name}] [gw2] [ 23%] PASSED test_executable_dictionary/test.py::test_executable_source_exit_code_check test_executable_dictionary/test.py::test_executable_source_python [gw2] [ 24%] PASSED test_executable_dictionary/test.py::test_executable_source_python test_executable_dictionary/test.py::test_executable_source_updated_python [gw0] [ 25%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-True] [gw1] [ 26%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-key] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-False] [gw7] [ 27%] PASSED test_format_avro_confluent/test.py::test_select test_format_avro_confluent/test.py::test_select_auth [gw7] [ 28%] FAILED test_format_avro_confluent/test.py::test_select_auth test_format_avro_confluent/test.py::test_select_auth_encoded [gw9] [ 29%] PASSED test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table [gw7] [ 30%] PASSED test_format_avro_confluent/test.py::test_select_auth_encoded test_format_avro_confluent/test.py::test_select_auth_encoded_complex [gw7] [ 31%] PASSED test_format_avro_confluent/test.py::test_select_auth_encoded_complex [gw1] [ 32%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-key] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] [gw5] [ 33%] PASSED test_keeper_profiler/test.py::test_profiler [gw8] [ 34%] PASSED test_log_query_probability/test.py::test_log_quries_probability_one test_log_query_probability/test.py::test_log_quries_probability_two [gw3] [ 35%] PASSED test_polymorphic_parts/test.py::test_compact_parts_only test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] [gw1] [ 36%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] [gw4] [ 37%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-10000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-100000-SELECT sum(key) FROM {table_name}] [gw2] [ 38%] PASSED test_executable_dictionary/test.py::test_executable_source_updated_python [gw0] [ 39%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-True] [gw3] [ 40%] PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] test_profile_events_s3/test.py::test_profile_events [gw1] [ 41%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] test_log_levels_update/test.py::test_log_levels_update [gw6] [ 42%] PASSED test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 [gw3] [ 43%] PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] [gw1] [ 44%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-key] test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader [gw0] [ 45%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-False] [gw1] [ 46%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-key] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] [gw4] [ 47%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-100000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-1000-SELECT sum(key) FROM {table_name}] [gw1] [ 48%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] [gw0] [ 49%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-True] test_keeper_snapshot_small_distance/test.py::test_snapshot_and_load [gw9] [ 50%] PASSED test_log_levels_update/test.py::test_log_levels_update [gw5] [ 51%] FAILED test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader [gw1] [ 52%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] test_merge_tree_check_part_with_cache/test.py::test_check_part_with_cache [gw1] [ 53%] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] [gw0] [ 54%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-False] test_parallel_replicas_increase_error_count/test.py::test_increase_error_count [gw0] [ 55%] ERROR test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-True] [gw4] [ 56%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-1000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-10000-SELECT sum(key) FROM {table_name}] [gw2] [ 57%] PASSED test_profile_events_s3/test.py::test_profile_events [gw9] [ 58%] SKIPPED test_merge_tree_check_part_with_cache/test.py::test_check_part_with_cache [gw0] [ 59%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-False] [gw4] [ 60%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-10000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-100000-SELECT sum(key) FROM {table_name}] [gw0] [ 61%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-False] [gw3] [ 62%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-True] [gw5] [ 63%] PASSED test_parallel_replicas_increase_error_count/test.py::test_increase_error_count [gw0] [ 64%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-False] [gw4] [ 65%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-100000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-1000-SELECT sum(key) FROM {table_name}] [gw0] [ 66%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-True] [gw0] [ 67%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-True] [gw4] [ 68%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-1000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-10000-SELECT sum(key) FROM {table_name}] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-False] [gw0] [ 69%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-True] [gw4] [ 70%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-10000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-100000-SELECT sum(key) FROM {table_name}] [gw0] [ 71%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-True] [gw3] [ 72%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] test_polymorphic_parts/test.py::test_polymorphic_parts_index test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-False] [gw3] [ 73%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive [gw6] [ 74%] PASSED test_keeper_snapshot_small_distance/test.py::test_snapshot_and_load [gw3] [ 75%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_match_process_uid_against_data_owner/test.py::test_different_user [gw0] [ 76%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-True] [gw4] [ 77%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-100000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-1000-SELECT sum(key) FROM {table_name}] [gw0] [ 78%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-False] [gw0] [ 79%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-True] [gw4] [ 80%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-1000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-10000-SELECT sum(key) FROM {table_name}] [gw6] [ 81%] PASSED test_match_process_uid_against_data_owner/test.py::test_different_user [gw0] [ 82%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-False] [gw0] [ 83%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-True] [gw4] [ 84%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-10000-SELECT sum(key) FROM {table_name}] test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-100000-SELECT sum(key) FROM {table_name}] [gw0] [ 85%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-False] [gw0] [ 86%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-True] [gw4] [ 87%] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-100000-SELECT sum(key) FROM {table_name}] [gw0] [ 88%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-False] [gw0] [ 89%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-True] [gw0] [ 90%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-False] [gw0] [ 91%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-True] [gw0] [ 92%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-False] [gw0] [ 93%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-True] [gw0] [ 94%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-False] [gw0] [ 95%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-True] [gw0] [ 96%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-True] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-False] [gw0] [ 97%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-False] test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-True] [gw0] [ 98%] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-True] [gw8] [ 99%] PASSED test_log_query_probability/test.py::test_log_quries_probability_two test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant [gw8] [100%] PASSED test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant ==================================== ERRORS ==================================== _ ERROR at setup of test_alters[settings0-test_db-False-depends_on1-True-False] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="function") def fn_setup_tables(): node.query("DROP TABLE IF EXISTS src1 ON CLUSTER default") > node.query("DROP TABLE IF EXISTS tgt1 ON CLUSTER default") test_refreshable_mat_view_replicated/test.py:205: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3649: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 231, stderr: Received exception from server (version 25.3.8): E Code: 999. DB::Exception: Received from 172.16.1.5:9000. Coordination::Exception. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/default/max_log_ptr. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:113: Poco::Exception::Exception(String const&, int) @ 0x000000003833fa51 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001bd6ea31 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000c3a620b E 3. Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000010bdc464 E 4. Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000010bdb67f E 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:697: zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function, Coordination::Error*) @ 0x00000000312bc43a E 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:665: zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*) @ 0x00000000312bbbce E 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:634: zkutil::ZooKeeper::get(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x00000000312bb7c0 E 8. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:322: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr, bool) @ 0x00000000282a01b0 E 9. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1139: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, DB::QueryFlags) @ 0x0000000028255026 E 10. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:226: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr const&, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000002a397356 E 11. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:118: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000002a39499d E 12. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:91: DB::InterpreterDropQuery::executeSingleDropQuery(std::shared_ptr const&) @ 0x000000002a393021 E 13. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:72: DB::InterpreterDropQuery::execute() @ 0x000000002a392aad E 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1457: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002ac0cc83 E 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1624: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002ac04ba5 E 16. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002fd8a216 E 17. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002fdc9efa E 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x000000003851ae4f E 19. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000003851bb17 E 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x000000003842a36b E 21. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000038423f68 E 22. asan_thread_start(void*) @ 0x000000000c358e77 E 23. ? @ 0x00007fb76be46ac3 E 24. ? @ 0x00007fb76bed8850 E . (KEEPER_EXCEPTION) E (query: DROP TABLE IF EXISTS tgt1 ON CLUSTER default) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log setup ------------------------------ 2026-03-22 17:45:54.702000 [ 593 ] DEBUG : Executing query DROP TABLE IF EXISTS src1 ON CLUSTER default on node1_1 (cluster.py:3648, query) 2026-03-22 17:45:55.710000 [ 593 ] DEBUG : Executing query DROP TABLE IF EXISTS tgt1 ON CLUSTER default on node1_1 (cluster.py:3648, query) =================================== FAILURES =================================== _______________________________ test_select_auth _______________________________ [gw7] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_select_auth(started_cluster): # type: (ClickHouseCluster) -> None reg_url = "http://localhost:{}".format(started_cluster.schema_registry_auth_port) arg = { "url": reg_url, "basic.auth.credentials.source": "USER_INFO", "basic.auth.user.info": "schemauser:letmein", } schema_registry_client = CachedSchemaRegistryClient(arg) serializer = MessageSerializer(schema_registry_client) schema = avro.schema.make_avsc_object( { "name": "test_record_auth", "type": "record", "fields": [{"name": "value", "type": "long"}], } ) buf = io.BytesIO() for x in range(0, 3): > message = serializer.encode_record_with_schema( "test_subject_auth", schema, {"value": x} ) test_format_avro_confluent/test.py:111: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/local/lib/python3.10/dist-packages/confluent_kafka/avro/serializer/message_serializer.py:109: in encode_record_with_schema schema_id = self.registry_client.register(subject, schema) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = subject = 'test_subject_auth-value' avro_schema = def register(self, subject, avro_schema): """ POST /subjects/(string: subject)/versions Register a schema with the registry under the given subject and receive a schema id. avro_schema must be a parsed schema from the python avro library Multiple instances of the same schema will result in cache misses. :param str subject: subject name :param schema avro_schema: Avro schema to be registered :returns: schema_id :rtype: int """ schemas_to_id = self.subject_to_schema_ids[subject] schema_id = schemas_to_id.get(avro_schema, None) if schema_id is not None: return schema_id # send it up url = '/'.join([self.url, 'subjects', subject, 'versions']) # body is { schema : json_string } body = {'schema': str(avro_schema)} result, code = self._send_request(url, method='POST', body=body) if (code == 401 or code == 403): raise ClientError("Unauthorized access. Error code:" + str(code) + " message:" + str(result)) elif code == 409: raise ClientError("Incompatible Avro schema:" + str(code) + " message:" + str(result)) elif code == 422: raise ClientError("Invalid Avro schema:" + str(code) + " message:" + str(result)) elif not (code >= 200 and code <= 299): > raise ClientError("Unable to register schema. Error code:" + str(code) + " message:" + str(result)) E confluent_kafka.avro.error.ClientError: Unable to register schema. Error code:500 message:{'error_code': 50002, 'message': 'Register operation timed out'} /usr/local/lib/python3.10/dist-packages/confluent_kafka/avro/cached_schema_registry_client.py:265: ClientError ------------------------------ Captured log call ------------------------------- 2026-03-22 17:44:16.769000 [ 614 ] DEBUG : Starting new HTTP connection (1): localhost:30352 (connectionpool.py:245, _new_conn) 2026-03-22 17:44:20.056000 [ 614 ] DEBUG : http://localhost:30352 "POST /subjects/test_subject_auth-value/versions HTTP/1.1" 500 61 (connectionpool.py:547, _make_request) ______________________ test_reconfig_remove_2_and_leader _______________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_reconfig_remove_2_and_leader(started_cluster): """ Remove 2 followers from a cluster of 5. Remove leader from 3 nodes. """ global zk1, zk2, zk3, zk4, zk5 zk1 = create_client(node1) config = ku.get_config_str(zk1) print("Initial config", config) assert len(config.split("\n")) == 5 for i in range(100): zk1.create(f"/test_two_{i}", "somedata") zk4 = create_client(node4) zk4.sync("/test_two_0") ku.wait_configs_equal(config, zk4) zk5 = create_client(node5) > zk5.sync("/test_two_0") test_keeper_reconfig_remove_many/test.py:64: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/keeper_utils.py:197: in sync self.execute_query(f"sync '{path}'", timeout) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = query = "sync '/test_two_0'", timeout = 60.0 def execute_query(self, query: str, timeout: float = 60.0) -> str: output = io.BytesIO() self.proc.stdin.write(query.encode() + b"\n") self.proc.stdin.flush() events = self.poller.poll(timeout) if not events: raise TimeoutError(f"Keeper client returned no output") for fd_num, event in events: if event & (select.EPOLLIN | select.EPOLLPRI): file = self._fd_nums[fd_num] if file == self.proc.stdout: while True: chunk = file.readline() if chunk.endswith(self.SEPARATOR): break output.write(chunk) elif file == self.proc.stderr: self.proc.stdout.readline() > raise KeeperException(self.proc.stderr.readline().strip().decode()) E helpers.keeper_utils.KeeperException: Code: 999. Coordination::Exception: Received error in heartbeat response: Operation timeout. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): helpers/keeper_utils.py:160: KeeperException ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ------------------------------ Captured log setup ------------------------------ 2026-03-22 17:44:54.179000 [ 608 ] INFO : Running tests in /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/test.py (cluster.py:2738, start) 2026-03-22 17:44:54.180000 [ 608 ] DEBUG : Cluster start called. is_up=False (cluster.py:2745, start) 2026-03-22 17:44:54.207000 [ 608 ] DEBUG : Docker networks for project roottestkeeperreconfigremovemany-gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:830, print_all_docker_pieces) 2026-03-22 17:44:54.249000 [ 608 ] DEBUG : Docker containers for project roottestkeeperreconfigremovemany-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:838, print_all_docker_pieces) 2026-03-22 17:44:54.279000 [ 608 ] DEBUG : Docker volumes for project roottestkeeperreconfigremovemany-gw5 are DRIVER VOLUME NAME (cluster.py:846, print_all_docker_pieces) 2026-03-22 17:44:54.280000 [ 608 ] DEBUG : Cleanup called (cluster.py:851, cleanup) 2026-03-22 17:44:54.311000 [ 608 ] DEBUG : Docker networks for project roottestkeeperreconfigremovemany-gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:830, print_all_docker_pieces) 2026-03-22 17:44:54.346000 [ 608 ] DEBUG : Docker containers for project roottestkeeperreconfigremovemany-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:838, print_all_docker_pieces) 2026-03-22 17:44:54.385000 [ 608 ] DEBUG : Docker volumes for project roottestkeeperreconfigremovemany-gw5 are DRIVER VOLUME NAME (cluster.py:846, print_all_docker_pieces) 2026-03-22 17:44:54.386000 [ 608 ] DEBUG : Command:[docker container list --all --filter name='^/roottestkeeperreconfigremovemany-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2026-03-22 17:44:54.440000 [ 608 ] DEBUG : Unstopped containers: {} (cluster.py:865, cleanup) 2026-03-22 17:44:54.441000 [ 608 ] DEBUG : No running containers for project: roottestkeeperreconfigremovemany-gw5 (cluster.py:879, cleanup) 2026-03-22 17:44:54.441000 [ 608 ] DEBUG : Trying to prune unused networks... (cluster.py:885, cleanup) 2026-03-22 17:44:54.464000 [ 608 ] DEBUG : Trying to prune unused images... (cluster.py:901, cleanup) 2026-03-22 17:44:54.464000 [ 608 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2026-03-22 17:44:54.502000 [ 608 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2026-03-22 17:44:54.503000 [ 608 ] DEBUG : Images pruned (cluster.py:904, cleanup) 2026-03-22 17:44:54.503000 [ 608 ] DEBUG : Trying to prune unused volumes... (cluster.py:910, cleanup) 2026-03-22 17:44:54.503000 [ 608 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2026-03-22 17:44:54.528000 [ 608 ] DEBUG : Stdout:8 (cluster.py:145, run_and_check) 2026-03-22 17:44:54.528000 [ 608 ] DEBUG : Command:[docker volume prune -f] (cluster.py:121, run_and_check) 2026-03-22 17:44:54.555000 [ 608 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2026-03-22 17:44:54.556000 [ 608 ] DEBUG : Volumes pruned: 8 (cluster.py:915, cleanup) 2026-03-22 17:44:54.556000 [ 608 ] DEBUG : Setup directory for instance: node1 (cluster.py:2758, start) 2026-03-22 17:44:54.557000 [ 608 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4628, create_dir) 2026-03-22 17:44:54.557000 [ 608 ] DEBUG : Create directory for common tests configuration (cluster.py:4633, create_dir) 2026-03-22 17:44:54.558000 [ 608 ] DEBUG : Copy common configuration from helpers (cluster.py:4653, create_dir) 2026-03-22 17:44:54.560000 [ 608 ] DEBUG : Generate and write macros file (cluster.py:4705, create_dir) 2026-03-22 17:44:54.561000 [ 608 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_reconfig_remove_many/configs/keeper1.xml'] to /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node1/configs/config.d (cluster.py:4741, create_dir) 2026-03-22 17:44:54.562000 [ 608 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node1/database (cluster.py:4758, create_dir) 2026-03-22 17:44:54.562000 [ 608 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node1/logs (cluster.py:4769, create_dir) 2026-03-22 17:44:54.563000 [ 608 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4850, create_dir) 2026-03-22 17:44:54.563000 [ 608 ] DEBUG : Setup directory for instance: node2 (cluster.py:2758, start) 2026-03-22 17:44:54.564000 [ 608 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4628, create_dir) 2026-03-22 17:44:54.564000 [ 608 ] DEBUG : Create directory for common tests configuration (cluster.py:4633, create_dir) 2026-03-22 17:44:54.565000 [ 608 ] DEBUG : Copy common configuration from helpers (cluster.py:4653, create_dir) 2026-03-22 17:44:54.565000 [ 608 ] DEBUG : Generate and write macros file (cluster.py:4705, create_dir) 2026-03-22 17:44:54.566000 [ 608 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_reconfig_remove_many/configs/keeper2.xml'] to /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node2/configs/config.d (cluster.py:4741, create_dir) 2026-03-22 17:44:54.566000 [ 608 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node2/database (cluster.py:4758, create_dir) 2026-03-22 17:44:54.566000 [ 608 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node2/logs (cluster.py:4769, create_dir) 2026-03-22 17:44:54.567000 [ 608 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4850, create_dir) 2026-03-22 17:44:54.567000 [ 608 ] DEBUG : Setup directory for instance: node3 (cluster.py:2758, start) 2026-03-22 17:44:54.567000 [ 608 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4628, create_dir) 2026-03-22 17:44:54.567000 [ 608 ] DEBUG : Create directory for common tests configuration (cluster.py:4633, create_dir) 2026-03-22 17:44:54.568000 [ 608 ] DEBUG : Copy common configuration from helpers (cluster.py:4653, create_dir) 2026-03-22 17:44:54.568000 [ 608 ] DEBUG : Generate and write macros file (cluster.py:4705, create_dir) 2026-03-22 17:44:54.569000 [ 608 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_reconfig_remove_many/configs/keeper3.xml'] to /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node3/configs/config.d (cluster.py:4741, create_dir) 2026-03-22 17:44:54.570000 [ 608 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node3/database (cluster.py:4758, create_dir) 2026-03-22 17:44:54.570000 [ 608 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node3/logs (cluster.py:4769, create_dir) 2026-03-22 17:44:54.571000 [ 608 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4850, create_dir) 2026-03-22 17:44:54.571000 [ 608 ] DEBUG : Setup directory for instance: node4 (cluster.py:2758, start) 2026-03-22 17:44:54.571000 [ 608 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4628, create_dir) 2026-03-22 17:44:54.577000 [ 608 ] DEBUG : Create directory for common tests configuration (cluster.py:4633, create_dir) 2026-03-22 17:44:54.578000 [ 608 ] DEBUG : Copy common configuration from helpers (cluster.py:4653, create_dir) 2026-03-22 17:44:54.579000 [ 608 ] DEBUG : Generate and write macros file (cluster.py:4705, create_dir) 2026-03-22 17:44:54.579000 [ 608 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_reconfig_remove_many/configs/keeper4.xml'] to /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node4/configs/config.d (cluster.py:4741, create_dir) 2026-03-22 17:44:54.580000 [ 608 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node4/database (cluster.py:4758, create_dir) 2026-03-22 17:44:54.580000 [ 608 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node4/logs (cluster.py:4769, create_dir) 2026-03-22 17:44:54.580000 [ 608 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4850, create_dir) 2026-03-22 17:44:54.580000 [ 608 ] DEBUG : Setup directory for instance: node5 (cluster.py:2758, start) 2026-03-22 17:44:54.583000 [ 608 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4628, create_dir) 2026-03-22 17:44:54.583000 [ 608 ] DEBUG : Create directory for common tests configuration (cluster.py:4633, create_dir) 2026-03-22 17:44:54.583000 [ 608 ] DEBUG : Copy common configuration from helpers (cluster.py:4653, create_dir) 2026-03-22 17:44:54.584000 [ 608 ] DEBUG : Generate and write macros file (cluster.py:4705, create_dir) 2026-03-22 17:44:54.585000 [ 608 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_reconfig_remove_many/configs/keeper5.xml'] to /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node5/configs/config.d (cluster.py:4741, create_dir) 2026-03-22 17:44:54.586000 [ 608 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node5/database (cluster.py:4758, create_dir) 2026-03-22 17:44:54.586000 [ 608 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node5/logs (cluster.py:4769, create_dir) 2026-03-22 17:44:54.586000 [ 608 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4850, create_dir) 2026-03-22 17:44:54.587000 [ 608 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/.env (cluster.py:96, _create_env_file) 2026-03-22 17:44:54.590000 [ 608 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-03-22 17:44:54.590000 [ 608 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-03-22 17:44:54.590000 [ 608 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-03-22 17:44:54.590000 [ 608 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-03-22 17:44:54.610000 [ 608 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2026-03-22 17:44:54.613000 [ 608 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/.env --project-name roottestkeeperreconfigremovemany-gw5 --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node4/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node5/docker-compose.yml pull] (cluster.py:121, run_and_check) 2026-03-22 17:44:58.456000 [ 608 ] DEBUG : Stderr: node3 Skipped - Image is already being pulled by node2 (cluster.py:147, run_and_check) 2026-03-22 17:44:58.456000 [ 608 ] DEBUG : Stderr: node4 Skipped - Image is already being pulled by node2 (cluster.py:147, run_and_check) 2026-03-22 17:44:58.456000 [ 608 ] DEBUG : Stderr: node5 Skipped - Image is already being pulled by node2 (cluster.py:147, run_and_check) 2026-03-22 17:44:58.456000 [ 608 ] DEBUG : Stderr: node1 Skipped - Image is already being pulled by node2 (cluster.py:147, run_and_check) 2026-03-22 17:44:58.456000 [ 608 ] DEBUG : Stderr: node2 Pulling (cluster.py:147, run_and_check) 2026-03-22 17:44:58.456000 [ 608 ] DEBUG : Stderr: node2 Pulled (cluster.py:147, run_and_check) 2026-03-22 17:44:58.456000 [ 608 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/.env --project-name roottestkeeperreconfigremovemany-gw5 --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node4/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node5/docker-compose.yml up -d --no-recreate') (cluster.py:3139, start) 2026-03-22 17:44:58.456000 [ 608 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/.env --project-name roottestkeeperreconfigremovemany-gw5 --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node4/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node5/docker-compose.yml up -d --no-recreate] (cluster.py:121, run_and_check) 2026-03-22 17:45:01.804000 [ 608 ] DEBUG : Stderr: Network roottestkeeperreconfigremovemany-gw5_default Creating (cluster.py:147, run_and_check) 2026-03-22 17:45:01.805000 [ 608 ] DEBUG : Stderr: Network roottestkeeperreconfigremovemany-gw5_default Created (cluster.py:147, run_and_check) 2026-03-22 17:45:01.805000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node1-1 Creating (cluster.py:147, run_and_check) 2026-03-22 17:45:01.805000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node3-1 Creating (cluster.py:147, run_and_check) 2026-03-22 17:45:01.805000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node2-1 Creating (cluster.py:147, run_and_check) 2026-03-22 17:45:01.805000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node4-1 Creating (cluster.py:147, run_and_check) 2026-03-22 17:45:01.806000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node5-1 Creating (cluster.py:147, run_and_check) 2026-03-22 17:45:01.806000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node1-1 Created (cluster.py:147, run_and_check) 2026-03-22 17:45:01.806000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node2-1 Created (cluster.py:147, run_and_check) 2026-03-22 17:45:01.806000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node4-1 Created (cluster.py:147, run_and_check) 2026-03-22 17:45:01.806000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node5-1 Created (cluster.py:147, run_and_check) 2026-03-22 17:45:01.807000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node3-1 Created (cluster.py:147, run_and_check) 2026-03-22 17:45:01.807000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node3-1 Starting (cluster.py:147, run_and_check) 2026-03-22 17:45:01.807000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node4-1 Starting (cluster.py:147, run_and_check) 2026-03-22 17:45:01.807000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node5-1 Starting (cluster.py:147, run_and_check) 2026-03-22 17:45:01.807000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node1-1 Starting (cluster.py:147, run_and_check) 2026-03-22 17:45:01.808000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node2-1 Starting (cluster.py:147, run_and_check) 2026-03-22 17:45:01.808000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node3-1 Started (cluster.py:147, run_and_check) 2026-03-22 17:45:01.808000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node4-1 Started (cluster.py:147, run_and_check) 2026-03-22 17:45:01.808000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node1-1 Started (cluster.py:147, run_and_check) 2026-03-22 17:45:01.808000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node5-1 Started (cluster.py:147, run_and_check) 2026-03-22 17:45:01.808000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node2-1 Started (cluster.py:147, run_and_check) 2026-03-22 17:45:01.809000 [ 608 ] DEBUG : ClickHouse instance created (cluster.py:3147, start) 2026-03-22 17:45:01.809000 [ 608 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2005, get_instance_ip) 2026-03-22 17:45:01.862000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:01.864000 [ 608 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2015, get_instance_global_ipv6) 2026-03-22 17:45:01.866000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:01.867000 [ 608 ] DEBUG : Waiting for ClickHouse start in node1, ip: 172.16.6.5... (cluster.py:3155, start) 2026-03-22 17:45:01.869000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:01.874000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:01.989000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:02.103000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:02.210000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:02.320000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:02.427000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:02.533000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:02.641000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:02.750000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:02.857000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:02.963000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:03.071000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:03.178000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:03.287000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:03.392000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:03.501000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:03.608000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:03.722000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:03.828000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:03.937000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:04.041000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:04.148000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:04.252000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:04.382000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:04.486000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:04.591000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:04.697000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:04.802000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:04.907000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:05.012000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:05.117000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:05.222000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:05.326000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:05.431000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:05.560000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:05.665000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:05.774000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:05.879000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:05.984000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:06.088000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:06.193000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:06.298000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:06.431000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:06.535000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:06.640000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:06.744000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:06.855000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:06.960000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:07.064000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:07.168000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:07.272000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:07.377000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:07.481000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:07.585000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:07.692000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:07.818000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:07.922000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:08.030000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:08.139000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:08.243000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:08.352000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:08.480000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:08.584000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:08.689000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:08.808000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:08.916000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:09.025000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:09.134000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:09.238000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:09.347000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:09.454000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:09.561000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:09.672000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:09.794000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:09.905000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:10.014000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:10.119000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:10.229000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:10.340000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:10.446000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:10.553000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:10.663000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:10.772000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:10.879000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:10.983000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.087000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.204000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.323000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.459000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.567000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/65521e7b01ae1cba1a1360298279148957849ad1832db4a4b257867d69f88eba/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.568000 [ 608 ] DEBUG : ClickHouse node1 started (cluster.py:3159, start) 2026-03-22 17:45:11.569000 [ 608 ] DEBUG : get_instance_ip instance_name=node2 (cluster.py:2005, get_instance_ip) 2026-03-22 17:45:11.575000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.578000 [ 608 ] DEBUG : get_instance_ip instance_name=node2 (cluster.py:2015, get_instance_global_ipv6) 2026-03-22 17:45:11.580000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.581000 [ 608 ] DEBUG : Waiting for ClickHouse start in node2, ip: 172.16.6.4... (cluster.py:3155, start) 2026-03-22 17:45:11.583000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.624000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/169a7a093f34ea37697b0486ee018d6800fa07d16a5bc578cea649fb39be0348/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.731000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/169a7a093f34ea37697b0486ee018d6800fa07d16a5bc578cea649fb39be0348/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.841000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/169a7a093f34ea37697b0486ee018d6800fa07d16a5bc578cea649fb39be0348/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:11.947000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/169a7a093f34ea37697b0486ee018d6800fa07d16a5bc578cea649fb39be0348/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.064000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/169a7a093f34ea37697b0486ee018d6800fa07d16a5bc578cea649fb39be0348/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.065000 [ 608 ] DEBUG : ClickHouse node2 started (cluster.py:3159, start) 2026-03-22 17:45:12.066000 [ 608 ] DEBUG : get_instance_ip instance_name=node3 (cluster.py:2005, get_instance_ip) 2026-03-22 17:45:12.074000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.076000 [ 608 ] DEBUG : get_instance_ip instance_name=node3 (cluster.py:2015, get_instance_global_ipv6) 2026-03-22 17:45:12.079000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.081000 [ 608 ] DEBUG : Waiting for ClickHouse start in node3, ip: 172.16.6.2... (cluster.py:3155, start) 2026-03-22 17:45:12.089000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.097000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/d1082e241c89ee87e8ed87447f4ba74c1b314225f7c7bd55ed1b54af0a554c66/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.111000 [ 608 ] DEBUG : ClickHouse node3 started (cluster.py:3159, start) 2026-03-22 17:45:12.112000 [ 608 ] DEBUG : get_instance_ip instance_name=node4 (cluster.py:2005, get_instance_ip) 2026-03-22 17:45:12.119000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node4-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.120000 [ 608 ] DEBUG : get_instance_ip instance_name=node4 (cluster.py:2015, get_instance_global_ipv6) 2026-03-22 17:45:12.126000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node4-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.127000 [ 608 ] DEBUG : Waiting for ClickHouse start in node4, ip: 172.16.6.3... (cluster.py:3155, start) 2026-03-22 17:45:12.130000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node4-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.181000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/181efa02b2b9fe5b02b0015eff9a4bf71c6125f9c9ff14fd4d1e8eca3979f96d/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.182000 [ 608 ] DEBUG : ClickHouse node4 started (cluster.py:3159, start) 2026-03-22 17:45:12.183000 [ 608 ] DEBUG : get_instance_ip instance_name=node5 (cluster.py:2005, get_instance_ip) 2026-03-22 17:45:12.190000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node5-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.191000 [ 608 ] DEBUG : get_instance_ip instance_name=node5 (cluster.py:2015, get_instance_global_ipv6) 2026-03-22 17:45:12.193000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node5-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.194000 [ 608 ] DEBUG : Waiting for ClickHouse start in node5, ip: 172.16.6.6... (cluster.py:3155, start) 2026-03-22 17:45:12.195000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node5-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.204000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/edf7cf97644e5bd6d8b2b101774b3ff8546936ad70ec6b5abc4bde7764cec252/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:12.206000 [ 608 ] DEBUG : ClickHouse node5 started (cluster.py:3159, start) ----------------------------- Captured stdout call ----------------------------- Initial config server.1=node1:9234;participant;1 server.2=node2:9234;participant;1 server.3=node3:9234;participant;1 server.4=node4:9234;participant;1 server.5=node5:9234;participant;1 ------------------------------ Captured log call ------------------------------- 2026-03-22 17:45:12.287000 [ 608 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2005, get_instance_ip) 2026-03-22 17:45:12.417000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:17.361000 [ 608 ] DEBUG : get_instance_ip instance_name=node4 (cluster.py:2005, get_instance_ip) 2026-03-22 17:45:17.367000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node4-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-03-22 17:45:18.220000 [ 608 ] DEBUG : get_instance_ip instance_name=node5 (cluster.py:2005, get_instance_ip) 2026-03-22 17:45:18.233000 [ 608 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestkeeperreconfigremovemany-gw5-node5-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) ---------------------------- Captured log teardown ----------------------------- 2026-03-22 17:45:30.066000 [ 608 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/.env --project-name roottestkeeperreconfigremovemany-gw5 --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node4/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node5/docker-compose.yml stop --timeout 20] (cluster.py:121, run_and_check) 2026-03-22 17:45:51.985000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node5-1 Stopping (cluster.py:147, run_and_check) 2026-03-22 17:45:51.988000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node1-1 Stopping (cluster.py:147, run_and_check) 2026-03-22 17:45:51.988000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node2-1 Stopping (cluster.py:147, run_and_check) 2026-03-22 17:45:51.988000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node3-1 Stopping (cluster.py:147, run_and_check) 2026-03-22 17:45:51.988000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node4-1 Stopping (cluster.py:147, run_and_check) 2026-03-22 17:45:51.988000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node3-1 Stopped (cluster.py:147, run_and_check) 2026-03-22 17:45:51.988000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node2-1 Stopped (cluster.py:147, run_and_check) 2026-03-22 17:45:51.989000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node4-1 Stopped (cluster.py:147, run_and_check) 2026-03-22 17:45:51.989000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node5-1 Stopped (cluster.py:147, run_and_check) 2026-03-22 17:45:51.989000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node1-1 Stopped (cluster.py:147, run_and_check) 2026-03-22 17:45:51.990000 [ 608 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2026-03-22 17:45:52.062000 [ 608 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2026-03-22 17:45:52.130000 [ 608 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2026-03-22 17:45:52.287000 [ 608 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node4/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node4/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2026-03-22 17:45:52.377000 [ 608 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node5/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node5/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2026-03-22 17:45:52.496000 [ 608 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/.env --project-name roottestkeeperreconfigremovemany-gw5 --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node4/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_reconfig_remove_many/_instances-0-gw5/node5/docker-compose.yml down --volumes] (cluster.py:121, run_and_check) 2026-03-22 17:45:55.017000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node1-1 Stopping (cluster.py:147, run_and_check) 2026-03-22 17:45:55.017000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node2-1 Stopping (cluster.py:147, run_and_check) 2026-03-22 17:45:55.017000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node3-1 Stopping (cluster.py:147, run_and_check) 2026-03-22 17:45:55.017000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node4-1 Stopping (cluster.py:147, run_and_check) 2026-03-22 17:45:55.017000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node5-1 Stopping (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node3-1 Stopped (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node3-1 Removing (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node2-1 Stopped (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node2-1 Removing (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node5-1 Stopped (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node5-1 Removing (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node1-1 Stopped (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node1-1 Removing (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node4-1 Stopped (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node4-1 Removing (cluster.py:147, run_and_check) 2026-03-22 17:45:55.018000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node4-1 Removed (cluster.py:147, run_and_check) 2026-03-22 17:45:55.019000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node5-1 Removed (cluster.py:147, run_and_check) 2026-03-22 17:45:55.019000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node2-1 Removed (cluster.py:147, run_and_check) 2026-03-22 17:45:55.019000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node3-1 Removed (cluster.py:147, run_and_check) 2026-03-22 17:45:55.019000 [ 608 ] DEBUG : Stderr: Container roottestkeeperreconfigremovemany-gw5-node1-1 Removed (cluster.py:147, run_and_check) 2026-03-22 17:45:55.019000 [ 608 ] DEBUG : Stderr: Network roottestkeeperreconfigremovemany-gw5_default Removing (cluster.py:147, run_and_check) 2026-03-22 17:45:55.019000 [ 608 ] DEBUG : Stderr: Network roottestkeeperreconfigremovemany-gw5_default Removed (cluster.py:147, run_and_check) 2026-03-22 17:45:55.021000 [ 608 ] DEBUG : Cleanup called (cluster.py:851, cleanup) 2026-03-22 17:45:55.103000 [ 608 ] DEBUG : Docker networks for project roottestkeeperreconfigremovemany-gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:830, print_all_docker_pieces) 2026-03-22 17:45:55.206000 [ 608 ] DEBUG : Docker containers for project roottestkeeperreconfigremovemany-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:838, print_all_docker_pieces) 2026-03-22 17:45:55.311000 [ 608 ] DEBUG : Docker volumes for project roottestkeeperreconfigremovemany-gw5 are DRIVER VOLUME NAME (cluster.py:846, print_all_docker_pieces) 2026-03-22 17:45:55.312000 [ 608 ] DEBUG : Command:[docker container list --all --filter name='^/roottestkeeperreconfigremovemany-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2026-03-22 17:45:55.432000 [ 608 ] DEBUG : Unstopped containers: {} (cluster.py:865, cleanup) 2026-03-22 17:45:55.433000 [ 608 ] DEBUG : No running containers for project: roottestkeeperreconfigremovemany-gw5 (cluster.py:879, cleanup) 2026-03-22 17:45:55.433000 [ 608 ] DEBUG : Trying to prune unused networks... (cluster.py:885, cleanup) 2026-03-22 17:45:55.538000 [ 608 ] DEBUG : Trying to prune unused images... (cluster.py:901, cleanup) 2026-03-22 17:45:55.538000 [ 608 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2026-03-22 17:45:55.611000 [ 608 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2026-03-22 17:45:55.612000 [ 608 ] DEBUG : Images pruned (cluster.py:904, cleanup) 2026-03-22 17:45:55.612000 [ 608 ] DEBUG : Trying to prune unused volumes... (cluster.py:910, cleanup) 2026-03-22 17:45:55.612000 [ 608 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2026-03-22 17:45:55.690000 [ 608 ] DEBUG : Stdout:3 (cluster.py:145, run_and_check) 2026-03-22 17:45:55.691000 [ 608 ] DEBUG : Command:[docker volume prune -f] (cluster.py:121, run_and_check) 2026-03-22 17:45:55.754000 [ 608 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2026-03-22 17:45:55.754000 [ 608 ] DEBUG : Volumes pruned: 3 (cluster.py:915, cleanup) ----------------- generated report log file: parallel1_0.jsonl ----------------- ============================== slowest durations =============================== 517.61s call test_log_query_probability/test.py::test_log_quries_probability_two 106.08s call test_keeper_snapshot_small_distance/test.py::test_snapshot_and_load 102.82s call test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] 72.95s call test_log_query_probability/test.py::test_log_quries_probability_one 68.08s setup test_format_avro_confluent/test.py::test_select 57.20s call test_polymorphic_parts/test.py::test_compact_parts_only 56.15s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-1000-SELECT sum(key) FROM {table_name}] 55.29s call test_profile_events_s3/test.py::test_profile_events 54.83s call test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] 42.66s call test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 38.51s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-False] 36.42s setup test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table 36.12s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-10000-SELECT sum(key) FROM {table_name}] 35.99s setup test_keeper_profiler/test.py::test_profiler 33.70s setup test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 31.76s teardown test_format_avro_confluent/test.py::test_select_auth_encoded_complex 31.52s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-100000-SELECT sum(key) FROM {table_name}] 31.46s setup test_polymorphic_parts/test.py::test_compact_parts_only 31.40s setup test_keeper_snapshot_small_distance/test.py::test_snapshot_and_load 30.27s setup test_parallel_replicas_increase_error_count/test.py::test_increase_error_count 29.30s teardown test_kerberos_auth/test.py::test_kerberos_auth_without_keytab 29.13s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-1000-SELECT sum(key) FROM {table_name}] 28.99s call test_executable_dictionary/test.py::test_executable_source_updated_python 27.64s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-key] 26.69s teardown test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 26.52s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-1000-SELECT sum(key) FROM {table_name}] 26.48s teardown test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 26.38s setup test_merge_tree_check_part_with_cache/test.py::test_check_part_with_cache 26.30s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-True] 26.14s teardown test_profile_events_s3/test.py::test_profile_events 25.88s setup test_executable_dictionary/test.py::test_executable_input_bash 25.37s teardown test_merge_tree_check_part_with_cache/test.py::test_check_part_with_cache 24.73s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-10000-SELECT sum(key) FROM {table_name}] 24.58s teardown test_keeper_profiler/test.py::test_profiler 24.55s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] 24.27s setup test_profile_events_s3/test.py::test_profile_events 24.15s teardown test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table 22.09s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-100000-SELECT sum(key) FROM {table_name}] 20.86s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-10000-SELECT sum(key) FROM {table_name}] 20.67s setup test_log_levels_update/test.py::test_log_levels_update 19.73s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-100000-SELECT sum(key) FROM {table_name}] 19.71s call test_log_levels_update/test.py::test_log_levels_update 18.07s setup test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 17.30s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] 17.14s setup test_kerberos_auth/test.py::test_bad_path_to_keytab 16.79s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-False] 16.70s setup test_password_constraints/test.py::test_complexity_rules 16.54s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-key] 16.52s call test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 15.76s teardown test_log_levels_update/test.py::test_log_levels_update 15.57s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-1000-SELECT sum(key) FROM {table_name}] 15.50s setup test_log_query_probability/test.py::test_log_quries_probability_one 15.46s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] 15.28s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive 15.09s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-sipHash64(key)] 14.96s setup test_max_authentication_methods_per_user/test.py::test_alter 13.79s setup test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 13.72s setup test_match_process_uid_against_data_owner/test.py::test_different_user 13.27s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-1000-SELECT sum(key) FROM {table_name}] 12.96s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-100000-SELECT sum(key) FROM {table_name}] 12.70s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-100000-SELECT sum(key) FROM {table_name}] 12.56s call test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table 12.40s call test_executable_dictionary/test.py::test_executable_input_slow_python 12.35s call test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-10000-SELECT sum(key) FROM {table_name}] 12.09s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] 11.76s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] 11.50s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-True] 11.11s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-True] 10.87s teardown test_parallel_replicas_increase_error_count/test.py::test_increase_error_count 10.82s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-True] 10.70s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-False] 10.56s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] 10.26s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-False] 10.20s call test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] 10.13s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-False] 9.55s call test_parallel_replicas_increase_error_count/test.py::test_increase_error_count 9.19s call test_match_process_uid_against_data_owner/test.py::test_different_user 8.83s teardown test_log_query_probability/test.py::test_log_quries_probability_two 8.59s call test_executable_dictionary/test.py::test_executable_source_python 7.96s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-key] 7.76s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-True] 7.64s call test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] 7.59s teardown test_password_constraints/test.py::test_default_password_type 7.40s teardown test_max_authentication_methods_per_user/test.py::test_create_default_setting 7.19s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-False] 7.09s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] 7.02s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-True] 6.86s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-False] 6.76s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-True] 6.75s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-False] 6.19s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-False] 6.11s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-True] 5.98s call test_executable_dictionary/test.py::test_executable_source_argument_python 5.97s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] 5.92s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-True] 5.70s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-True] 5.69s teardown test_executable_dictionary/test.py::test_executable_source_updated_python 5.59s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-False] 5.50s teardown test_keeper_snapshot_small_distance/test.py::test_snapshot_and_load 5.47s teardown test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 5.38s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-False] 5.27s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-True] 4.78s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-True] 4.63s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-False] 4.59s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-False] 4.50s call test_password_constraints/test.py::test_complexity_rules 4.50s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-key] 4.44s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-True] 4.40s call test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-key] 4.28s call test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-True] 4.25s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-False] 4.11s call test_executable_dictionary/test.py::test_executable_source_exit_code_check 4.08s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-True] 4.07s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-True] 4.05s call test_format_avro_confluent/test.py::test_select_auth 4.01s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-True] 4.01s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-False] 4.00s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-False] 3.96s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-True] 3.96s call test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive 3.95s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-False] 3.91s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-False] 3.90s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-False] 3.86s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-False] 3.86s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-False] 3.86s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-True] 3.81s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-True] 3.81s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-False] 3.81s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-True] 3.76s call test_polymorphic_parts/test.py::test_polymorphic_parts_index 3.76s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-True] 3.76s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-False] 3.66s call test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-True] 3.47s call test_format_avro_confluent/test.py::test_select 3.40s call test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 3.09s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-True] 2.93s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-True] 2.92s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-False] 2.77s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-True] 2.74s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-False] 2.72s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-False] 2.69s call test_executable_dictionary/test.py::test_executable_input_sum_python 2.67s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-False] 2.57s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-False] 2.57s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-False] 2.57s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-True] 2.57s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-True] 2.57s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-False] 2.55s call test_format_avro_confluent/test.py::test_select_auth_encoded 2.54s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-True] 2.52s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-True] 2.52s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-False] 2.52s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-True] 2.52s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-True] 2.52s setup test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-True] 2.35s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-False] 2.18s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-False] 2.05s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-True] 1.91s call test_max_authentication_methods_per_user/test.py::test_alter 1.90s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-True] 1.88s call test_format_avro_confluent/test.py::test_select_auth_encoded_complex 1.84s call test_executable_dictionary/test.py::test_executable_non_direct_input_bash 1.81s call test_max_authentication_methods_per_user/test.py::test_alter_default_setting 1.78s call test_max_authentication_methods_per_user/test.py::test_create_default_setting 1.69s teardown test_match_process_uid_against_data_owner/test.py::test_different_user 1.62s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-False] 1.39s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-True] 1.38s call test_executable_dictionary/test.py::test_executable_input_signalled_python 1.33s call test_executable_dictionary/test.py::test_executable_input_send_chunk_header_python 1.20s call test_executable_dictionary/test.py::test_executable_input_python 1.17s call test_max_authentication_methods_per_user/test.py::test_create 1.09s call test_executable_dictionary/test.py::test_executable_input_bash 0.95s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-False] 0.91s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-False] 0.84s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-True] 0.81s call test_password_constraints/test.py::test_default_password_type 0.79s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-True] 0.75s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-True] 0.74s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-True] 0.74s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-False] 0.74s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-False] 0.71s call test_keeper_profiler/test.py::test_profiler 0.70s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-True] 0.69s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-True] 0.69s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-False] 0.68s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-False] 0.64s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-True] 0.64s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-False] 0.64s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-False] 0.64s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-True] 0.63s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-False] 0.63s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-False] 0.59s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-True] 0.59s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-True] 0.58s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-True] 0.58s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-False] 0.58s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-False] 0.58s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-True] 0.53s call test_merge_tree_check_part_with_cache/test.py::test_check_part_with_cache 0.50s call test_kerberos_auth/test.py::test_bad_path_to_keytab 0.37s call test_kerberos_auth/test.py::test_kerberos_auth_without_keytab 0.27s call test_kerberos_auth/test.py::test_kerberos_auth_with_keytab 0.03s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] 0.01s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-1000-SELECT sum(key) FROM {table_name}] 0.01s teardown test_polymorphic_parts/test.py::test_compact_parts_only 0.01s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] 0.01s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] 0.01s teardown test_log_query_probability/test.py::test_log_quries_probability_one 0.01s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] 0.01s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-key] 0.01s setup test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] 0.01s setup test_polymorphic_parts/test.py::test_polymorphic_parts_index 0.01s setup test_executable_dictionary/test.py::test_executable_input_slow_python 0.01s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-100000-SELECT sum(key) FROM {table_name}] 0.01s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-key] 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-10000-SELECT sum(key) FROM {table_name}] 0.00s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-sipHash64(key)] 0.00s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] 0.00s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-10000-SELECT sum(key) FROM {table_name}] 0.00s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-1000-SELECT sum(key) FROM {table_name}] 0.00s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-10000-SELECT sum(key) FROM {table_name}] 0.00s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] 0.00s setup test_log_query_probability/test.py::test_log_quries_probability_two 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-100000-SELECT sum(key) FROM {table_name}] 0.00s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] 0.00s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] 0.00s teardown test_format_avro_confluent/test.py::test_select 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] 0.00s teardown test_executable_dictionary/test.py::test_executable_input_slow_python 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-100000-SELECT sum(key) FROM {table_name}] 0.00s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-1000-SELECT sum(key) FROM {table_name}] 0.00s setup test_executable_dictionary/test.py::test_executable_input_sum_python 0.00s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-key] 0.00s teardown test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] 0.00s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] 0.00s setup test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-10000-SELECT sum(key) FROM {table_name}] 0.00s setup test_executable_dictionary/test.py::test_executable_source_updated_python 0.00s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] 0.00s teardown test_executable_dictionary/test.py::test_executable_source_python 0.00s teardown test_executable_dictionary/test.py::test_executable_input_sum_python 0.00s setup test_format_avro_confluent/test.py::test_select_auth 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-100000-SELECT sum(key) FROM {table_name}] 0.00s setup test_kerberos_auth/test.py::test_kerberos_auth_with_keytab 0.00s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-10000-SELECT sum(key) FROM {table_name}] 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-1000-SELECT sum(key) FROM {table_name}] 0.00s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-sipHash64(key)] 0.00s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-key] 0.00s setup test_format_avro_confluent/test.py::test_select_auth_encoded 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-1000-SELECT sum(key) FROM {table_name}] 0.00s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-key] 0.00s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-1000-SELECT sum(key) FROM {table_name}] 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-10000-SELECT sum(key) FROM {table_name}] 0.00s setup test_executable_dictionary/test.py::test_executable_source_exit_code_check 0.00s teardown test_kerberos_auth/test.py::test_bad_path_to_keytab 0.00s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-100000-SELECT sum(key) FROM {table_name}] 0.00s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-key] 0.00s setup test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-10000-SELECT sum(key) FROM {table_name}] 0.00s teardown test_format_avro_confluent/test.py::test_select_auth 0.00s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-1000-SELECT sum(key) FROM {table_name}] 0.00s teardown test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-False] 0.00s setup test_executable_dictionary/test.py::test_executable_input_send_chunk_header_python 0.00s teardown test_executable_dictionary/test.py::test_executable_input_bash 0.00s setup test_executable_dictionary/test.py::test_executable_non_direct_input_bash 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] 0.00s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-100000-SELECT sum(key) FROM {table_name}] 0.00s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-key] 0.00s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] 0.00s setup test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] 0.00s setup test_kerberos_auth/test.py::test_kerberos_auth_without_keytab 0.00s setup test_max_authentication_methods_per_user/test.py::test_create_default_setting 0.00s teardown test_executable_dictionary/test.py::test_executable_source_argument_python 0.00s setup test_executable_dictionary/test.py::test_executable_source_python 0.00s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-100000-SELECT sum(key) FROM {table_name}] 0.00s setup test_executable_dictionary/test.py::test_executable_input_python 0.00s setup test_format_avro_confluent/test.py::test_select_auth_encoded_complex 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive 0.00s setup test_executable_dictionary/test.py::test_executable_source_argument_python 0.00s teardown test_executable_dictionary/test.py::test_executable_input_python 0.00s teardown test_password_constraints/test.py::test_complexity_rules 0.00s teardown test_executable_dictionary/test.py::test_executable_source_exit_code_check 0.00s teardown test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-10000-SELECT sum(key) FROM {table_name}] 0.00s teardown test_max_authentication_methods_per_user/test.py::test_alter 0.00s setup test_executable_dictionary/test.py::test_executable_input_signalled_python 0.00s teardown test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] 0.00s teardown test_executable_dictionary/test.py::test_executable_non_direct_input_bash 0.00s teardown test_executable_dictionary/test.py::test_executable_input_signalled_python 0.00s setup test_password_constraints/test.py::test_default_password_type 0.00s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_index 0.00s teardown test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] 0.00s setup test_max_authentication_methods_per_user/test.py::test_create 0.00s setup test_max_authentication_methods_per_user/test.py::test_alter_default_setting 0.00s teardown test_max_authentication_methods_per_user/test.py::test_create 0.00s teardown test_kerberos_auth/test.py::test_kerberos_auth_with_keytab 0.00s teardown test_format_avro_confluent/test.py::test_select_auth_encoded 0.00s teardown test_max_authentication_methods_per_user/test.py::test_alter_default_setting 0.00s teardown test_executable_dictionary/test.py::test_executable_input_send_chunk_header_python =========================== short test summary info ============================ FAILED test_format_avro_confluent/test.py::test_select_auth - confluent_kafka... FAILED test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader ERROR test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-False] PASSED test_max_authentication_methods_per_user/test.py::test_alter PASSED test_kerberos_auth/test.py::test_bad_path_to_keytab PASSED test_kerberos_auth/test.py::test_kerberos_auth_with_keytab PASSED test_kerberos_auth/test.py::test_kerberos_auth_without_keytab PASSED test_max_authentication_methods_per_user/test.py::test_alter_default_setting PASSED test_max_authentication_methods_per_user/test.py::test_create PASSED test_password_constraints/test.py::test_complexity_rules PASSED test_max_authentication_methods_per_user/test.py::test_create_default_setting PASSED test_password_constraints/test.py::test_default_password_type PASSED test_executable_dictionary/test.py::test_executable_input_bash PASSED test_executable_dictionary/test.py::test_executable_input_python PASSED test_executable_dictionary/test.py::test_executable_input_send_chunk_header_python PASSED test_executable_dictionary/test.py::test_executable_input_signalled_python PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-key] PASSED test_executable_dictionary/test.py::test_executable_input_slow_python PASSED test_executable_dictionary/test.py::test_executable_input_sum_python PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-sipHash64(key)] PASSED test_executable_dictionary/test.py::test_executable_non_direct_input_bash PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-False] PASSED test_executable_dictionary/test.py::test_executable_source_argument_python PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-key] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-1000-SELECT sum(key) FROM {table_name}] PASSED test_executable_dictionary/test.py::test_executable_source_exit_code_check PASSED test_executable_dictionary/test.py::test_executable_source_python PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-True] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] PASSED test_format_avro_confluent/test.py::test_select PASSED test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table PASSED test_format_avro_confluent/test.py::test_select_auth_encoded PASSED test_format_avro_confluent/test.py::test_select_auth_encoded_complex PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-key] PASSED test_keeper_profiler/test.py::test_profiler PASSED test_log_query_probability/test.py::test_log_quries_probability_one PASSED test_polymorphic_parts/test.py::test_compact_parts_only PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-10000-SELECT sum(key) FROM {table_name}] PASSED test_executable_dictionary/test.py::test_executable_source_updated_python PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-False] PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] PASSED test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-True] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-key] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-100000-SELECT sum(key) FROM {table_name}] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-False] PASSED test_log_levels_update/test.py::test_log_levels_update PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-key] PASSED test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-True] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-1000-SELECT sum(key) FROM {table_name}] PASSED test_profile_events_s3/test.py::test_profile_events PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-True] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-10000-SELECT sum(key) FROM {table_name}] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-False] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] PASSED test_parallel_replicas_increase_error_count/test.py::test_increase_error_count PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-True] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-100000-SELECT sum(key) FROM {table_name}] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-False] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-True] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-1000-SELECT sum(key) FROM {table_name}] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-False] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-10000-SELECT sum(key) FROM {table_name}] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-True] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_index PASSED test_keeper_snapshot_small_distance/test.py::test_snapshot_and_load PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-False] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-100000-SELECT sum(key) FROM {table_name}] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-True] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-False] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-1000-SELECT sum(key) FROM {table_name}] PASSED test_match_process_uid_against_data_owner/test.py::test_different_user PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-True] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-False] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-10000-SELECT sum(key) FROM {table_name}] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-True] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-False] PASSED test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-100000-SELECT sum(key) FROM {table_name}] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-True] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-False] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-True] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-False] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-True] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-False] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-True] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-False] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-True] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-False] PASSED test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-True] PASSED test_log_query_probability/test.py::test_log_quries_probability_two PASSED test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant SKIPPED [1] test_merge_tree_check_part_with_cache/test.py:28: Skip with debug build and sanitizers. This test manually corrupts cache which triggers LOGICAL_ERROR and leads to crash with those builds ========= 2 failed, 96 passed, 1 skipped, 1 error in 641.15s (0:10:41) ========= Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 492, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_vf4j2m --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel1_0.jsonl --report-log-exclude-logs-on-passed-tests test_executable_dictionary/test.py::test_executable_input_bash test_executable_dictionary/test.py::test_executable_input_python test_executable_dictionary/test.py::test_executable_input_send_chunk_header_python test_executable_dictionary/test.py::test_executable_input_signalled_python test_executable_dictionary/test.py::test_executable_input_slow_python test_executable_dictionary/test.py::test_executable_input_sum_python test_executable_dictionary/test.py::test_executable_non_direct_input_bash test_executable_dictionary/test.py::test_executable_source_argument_python test_executable_dictionary/test.py::test_executable_source_exit_code_check test_executable_dictionary/test.py::test_executable_source_python test_executable_dictionary/test.py::test_executable_source_updated_python test_format_avro_confluent/test.py::test_select test_format_avro_confluent/test.py::test_select_auth test_format_avro_confluent/test.py::test_select_auth_encoded test_format_avro_confluent/test.py::test_select_auth_encoded_complex test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 test_keeper_snapshot_small_distance/test.py::test_snapshot_and_load test_kerberos_auth/test.py::test_bad_path_to_keytab test_kerberos_auth/test.py::test_kerberos_auth_with_keytab test_kerberos_auth/test.py::test_kerberos_auth_without_keytab test_log_levels_update/test.py::test_log_levels_update test_log_query_probability/test.py::test_log_quries_probability_one test_log_query_probability/test.py::test_log_quries_probability_two test_match_process_uid_against_data_owner/test.py::test_different_user test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting test_merge_tree_check_part_with_cache/test.py::test_check_part_with_cache 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_multiple_shards_multiple_replicas-custom_key_sampling-sipHash64(key)]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_distributed[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_mergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_range-sipHash64(key)]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-key]' 'test_parallel_replicas_custom_key/test.py::test_parallel_replicas_custom_key_replicatedmergetree[test_single_shard_multiple_replicas-custom_key_sampling-sipHash64(key)]' test_parallel_replicas_increase_error_count/test.py::test_increase_error_count 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-1000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-10000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-101-100000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-1000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-10000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[1-11-100000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-1000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-10000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-101-100000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-1000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-10000-SELECT sum(key) FROM {table_name}]' 'test_parallel_replicas_invisible_parts/test.py::test_reading_with_invisible_parts[11-11-100000-SELECT sum(key) FROM {table_name}]' test_password_constraints/test.py::test_complexity_rules test_password_constraints/test.py::test_default_password_type test_polymorphic_parts/test.py::test_compact_parts_only 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact]' 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1]' test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_profile_events_s3/test.py::test_profile_events 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-None-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-False-depends_on1-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-None-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings0-test_db-True-depends_on1-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-None-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-False-depends_on1-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-None-True-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-False-True]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-False]' 'test_refreshable_mat_view_replicated/test.py::test_alters[settings1-test_db-True-depends_on1-True-True]' -vvv " altinityinfra/integration-tests-runner:226bfaf75ac1 ' returned non-zero exit status 1.